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Abstract — Recently, it has been shown that CSMA-type ran- 
dom access algorithms can achieve the maximum possible 
throughput in ad hoc wireless networks. However, these al- 
gorithms assume an idealized continuous-time CSMA protocol 
where collisions can never occur. In addition, simulation re- 
sults indicate that the delay performance of these algorithms 
can be quite bad. On the other hand, although some simple 
heuristics (such as distributed approximations of greedy maximal 
scheduling) can yield much better delay performance for a large 
set of arrival rates, they may only achieve a fraction of the 
capacity region in general. In this paper, we propose a discrete- 
time version of the CSMA algorithm. Central to our results is 
a discrete-time distributed randomized algorithm which is based 
on a generalization of the so-called Glauber dynamics from 
statistical physics, where multiple links are allowed to update 
their states in a single time slot. The algorithm generates collision- 
free transmission schedules while explicitly taking collisions into 
account during the control phase of the protocol, thus relaxing 
the perfect CSMA assumption. More importantly, the algorithm 
allows us to incorporate mechanisms which lead to very good 
delay performance while retaining the throughput-optimality 
property. It also resolves the hidden and exposed terminal 
problems associated with wireless networks. 



I. Introduction 

For wireless networks with limited resources, efficient re- 
source allocation and optimization (e.g., power control, link 
scheduling, routing, congestion control) play an important 
role in achieving high performance and providing satisfac- 
tory quality-of-service (QoS). In this paper, we study link 
scheduling (or Media Access Control, MAC) for wireless 
networks, where the links (node pairs) may not be able to 
transmit simultaneously due to transceiver constraints and 
radio interference. A scheduling algorithm (or MAC protocol) 
decides which links can transmit data at each time instant so 
that no two active links interfere with each other. 

The performance metrics of interest in this paper are 
throughput and delay. The throughput performance of a 
scheduling algorithm is often characterized by the largest set 
of arrival rates under which the algorithm can keep the queues 
in the network stable. The delay performance of a scheduling 
algorithm can be characterized by the average delay experi- 
enced by the packets transmitted in the network. Since many 
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wireless network applications have stringent bandwidth and 
delay requirements, designing high-performance scheduling 
algorithms to achieve maximum possible throughput and low 
delay is of great importance, which is the main objective of this 
paper. We also want the scheduling algorithms to be distributed 
and have low complexity/overhead, since in many wireless 
networks there is no centralized entity and the resources at 
the nodes are very limited. 

It is well known that the queue-length based Maximum 
Weight Scheduling (MWS) algorithm is throughput-optimal 
1 26], in the sense that it can stabilize the network queues for 
all arrival rates in the capacity region of the network (without 
explicitly knowing the arrival rates). However, for general 
interference models MWS requires the network to solve a 
complex combinatorial optimization problem in each time slot 
and hence, is not implementable in practice. 

Maximal scheduling is a low-complexity alternative to 
MWS but it may only achieve a small fraction of the capacity 
region (6J, ll29ll . Greedy Maximal Scheduling (GMS), also 
known as Longest-Queue-First (LQF) Scheduling, is another 
natural low-complexity alternative to MWS which has been 
observed to achieve very good throughput and delay per- 
formance in a variety of wireless network scenarios. GMS 
proceeds in a greedy manner by sequentially scheduling a link 
with the longest queue and disabling all its interfering links. 
It was shown in j7] that if the network satisfies the so-called 
local-pooling condition, then GMS is throughput-optimal; but 
for networks with general topology GMS may only achieve a 
fraction of the capacity region [14], [16|, [ 30 1. Moreover, while 
the computational complexity of GMS is low, the signaling and 
time overhead of decentralization of GMS can increase with 
the size of the network ifTBI . 

Another class of scheduling algorithms are CSMA (Car- 
rier Sense Multiple Access) type random access algorithms. 
Under CSMA, a node (sender of a link) will sense whether 
the channel is busy before it transmits a packet. When the 
node detects that the channel is busy, it will wait for a 
random backoff time. Since CSMA-type algorithms can be 
easily implemented in a distributed manner, they are widely 
used in practice (e.g., the IEEE 802.11 MAC protocol). In 
101 the authors derived an analytical model to calculate the 
throughput of a CSMA-type algorithm in multi-hop wireless 
networks. They showed that the Markov chain describing the 
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evolution of schedules has a product-form stationary distri- 
bution under an idealized continuous-time CSMA protocol 
(which assumes zero propagation/sensing delay and no hidden 
terminals) where collisions can never occur. Then the authors 
proposed a heuristic algorithm to select the CSMA parameters 
so that the link service rates are equal to the link arrival rates 
which were assumed to be known. No proof was given for 
the convergence of this algorithm. This model was used in 
lf27l to study throughput and fairness issues in wireless ad 
hoc networks. The insensitivity properties of such a CSMA 
algorithm have been recently studied in ifTTl . 

Based on the results in (4|, lf27l . IfTTl . a distributed algorithm 
was developed in lfl2l to adaptively choose the CSMA param- 
eters to meet the traffic demand without explicitly knowing the 
arrival rates. The results in |[T2l make a time-scale separation 
assumption, whereby the CSMA Markov chain converges to 
its steady-state distribution instantaneously compared to the 
time-scale of adaptation of the CSMA parameters. Then the 
authors suggested that this time-scale separation assumption 
can be justified using a stochastic-approximation type argu- 
ment which was verified in |19|, IfTTl . Preliminary ideas for 
a related result was reported in lf23l . where the authors study 
distributed algorithms for optical networks. But it is clear that 
their model also applies to wireless networks with CSMA. In 
lf24l . a slightly modified version of the algorithm proposed 
in ll23l was shown to be throughput-optimal. The key idea in 
lf24l is to choose the link weights to be a specific function 
of the queue lengths to essentially separate the time scales of 
the link weights and the CSMA dynamics. Further, the results 
in lf24l assume that the max-queue-length in the network is 
known which is estimated via a distributed message-passing 
procedure. Similar modifications to 802.11 have been studied 
in JJJ, lf28l where the back-pressure on a link is used as the 
weight instead of the queue length. 

While the results in our paper are most closely related to the 
works in ||4), lfl"2"l . [24|, we also note important contributions 
in 0, |H), lEOl . If22 l which make connections between random 
access algorithms and stochastic loss networks. 

Although the recent results on CSMA-type random access 
algorithms show throughput-optimality, simulation results in- 
dicate that the delay performance of these algorithms can be 
quite bad and much worse than MWS and GMS. Thus, one 
of our goals in this paper is to design distributed scheduling 
algorithms that have low complexity, are provably throughput- 
optimal, and have good delay performance. Towards this end, 
we design a discrete-time version of the CSMA random access 
algorithm. It is based on a generalization of the so-called 
Glauber dynamics from statistical physics, where multiple 
links are allowed to update their states based on their queue 
lengths in a single time slot. Our algorithm generates collision- 
free data transmission schedules while allowing for collisions 
during the control phase of the protocol (as in the 802.11 
MAC protocol), thus relaxing the perfect CSMA assumption 
of the algorithms studied in Q, IPT21 . If24l . Our approach to 
modeling collisions is different from the approaches in lfT3ll . 
|19|. In lfT9l the authors pointed out that, as the transmission 
probabilities are made small and the transmission lengths 
are made large, their discrete-time model approximates the 



continuous-time model with Poisson clocks, but it is difficult to 
quantify the throughput difference between these two models. 
The algorithm in |13] places upper bounds on the CSMA 
parameters, while the loss in throughput due to this design 
choice is also hard to quantify. Instead, we directly quantify the 
loss in throughput as the ratio of the duration of the control slot 
to the duration of the data slot (see Remark [TJ in Section ITvT ). 
More importantly, our formulation allows us to incorporate 
delay-reduction mechanisms in the choice of schedules while 
retaining the algorithm's throughput-optimality property. It 
also allows us to resolve the hidden and exposed terminal 
problems associated with wireless networks 0. 

We organize the paper as follows. In SectionQJJwe introduce 
the network model. In Section|III]we present the basic schedul- 
ing algorithm and show that the (discrete-time) Markov chain 
of the transmission schedules has a product-form distribution. 
In Section |IV] we present a distributed implementation of the 
basic scheduling algorithm, called Q-CSMA (Queue-length 
based CSMA/CA). In Section [V] we propose a hybrid Q- 
CSMA algorithm which combines Q-CSMA with a distributed 
procedure that approximates GMS to achieve both maximum 
throughput and low delay. We evaluate the performance of 
different scheduling algorithms via simulations in Section [VTI 
The paper is concluded in Section IVIII 

II. Network Model 

We model a (single-channel) wireless network by a graph 
G = (V, E), where V is the set of nodes and E is the set of 
links. Nodes are wireless transmitters/receivers. There exists a 
directed link (n, m) G E if node m can hear the transmission 
of node n. We assume that if (n, m) G E, then (m, n) G E. 

For any link i G E, we use C(i) to denote the set of 
conflicting links (called conflict set) of i, i.e., C(i) is the set of 
links such that if any one of them is active, then link i cannot 
be active. The conflict set C(i) may include 

> Links that share a common node with link i. This models 
the node-exclusive constraint where two links sharing a 
common node cannot be active simultaneously. 

• Links that will cause interference to link i when transmit- 
ting. This models the radio interference constraint where 
two links that are close to each other cannot be active 
simultaneously. 

We assume symmetry in the conflict set so that if i G C(j) 
then j G C(i). 

We consider a time-slotted system. A feasible (collision- 
free) schedule of G = ( V, E) is a set of links that can be active 
at the same time according to the conflict set constraint, i.e., 
no two links in a feasible schedule conflict with each other. We 
assume that all links have unit capacity, i.e., an active link can 
transmit one packet in one time slot under a feasible schedule. 
Note that the results in this paper can be readily extended to 
networks with arbitrary link capacities. 

A schedule is represented by a vector x G {0, 1}' B L The 
i th element of x is equal to 1 (i.e., Xi = 1) if link i is 
included in the schedule; Xi = otherwise. With a little bit 
abuse of notation, we also treat x as a set and write i G x if 
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Xi = 1. Note that a feasible schedule x satisfies the following 
condition: 

Xi + Xj < 1, for all i G E and j e C(i). (1) 

Let A4 be the set of all feasible schedules of the network. 

A scheduling algorithm is a procedure to decide which 
schedule to be used (i.e., which set of links to be activated) in 
every time slot for data transmission. In this paper we focus 
on the MAC layer so we only consider single-hop traffic. The 
capacity region of the network is the set of all arrival rates A 
for which there exists a scheduling algorithm that can stabilize 
the queues, i.e., the queues are bounded in some appropriate 
stochastic sense depending on the arrival model used. For 
the purposes of this paper, we will assume that if the arrival 
process is stochastic, then the resulting queue length process 
admits a Markovian description, in which case, stability refers 
to the positive recurrence of this Markov chain. It is known 
(e.g., [26 1) that the capacity region is given by 

A = {A | A > and 3fi e Co(M),X < //}, (2) 

where Co(M) is the convex hull of the set of feasible 
schedules in M.. When dealing with vectors, inequalities are 
interpreted component-wise. 

We say that a scheduling algorithm is throughput- optimal, or 
achieves the maximum throughput, if it can keep the network 
stable for all arrival rates in A. 

III. The Basic Scheduling Algorithm 

We divide each time slot t into a control slot and a data 
slot. (Later, we will further divide the control slot into control 
mini-slots.) The purpose of the control slot is to generate a 
collision-free transmission schedule x(i) G M used for data 
transmission in the data slot. To achieve this, the network first 
selects a set of links that do not conflict with each other, 
denoted by m(t). Note that these links also form a feasible 
schedule, but it is not the schedule used for data transmission. 
We call m(t) the decision schedule in time slot t. 

Let Ado C A4 be the set of possible decision schedules. 
The network selects a decision schedule according to 
a randomized procedure, i.e., it selects m(t) G A4q with 
positive probability a(m(i)), where 2~2 m (t)eM a ( m W) = 1- 
Then, the transmission schedule is determined as follows. 
For any link i in m(t), if no links in C(i) were active in the 
previous data slot, then link i is chosen to be active with 
an activation probability pi and inactive with probability 
1 — pi in the current data slot. If at least one link in C(i) 
was active in the previous data slot, then i will be inactive 
in the current data slot. Any link not selected by m(t) 
will maintain its state (active or inactive) from the previous 
data slot. Conditions on the set of decision schedules A4q 
and the link activation probabilities p^s will be specified later. 



Basic Scheduling Algorithm (in Time Slot t) 



1. In the control slot, randomly select a decision schedule 
m(t) G A4q with probability a(m(t)). 



Vi G m(i): 

If no links in C(i) were active in the previous data 
slot, i.e., Ejec(i) - 

(a) Xi(t) = 1 with probability p^ < pi < 1; 

(b) Xi(t) = with probability pi = 1 — pi. 
Else 

(c) Xi[t)=0. 
Mi ^ m(t) : 

(d) Xi{t)=Xi{t-\). 

2. In the data slot, use x(t) as the transmission schedule. 



Note that the algorithm is a generalization of the so-called 
Glauber dynamics from statistical physics 1211 . where multiple 
links are allowed to update their states in a single time slot. 
First we will show that if the transmission schedule used in 
the previous data slot and the decision schedule selected in 
the current control slot both are feasible, then the transmission 
schedule generated in the current data slot is also feasible. 

Lemma 1: If x(< — 1) € M and m(i) G M, then x(<) G 
M. 

Proof: Note that x G M if and only if Vi G E such that 
Xi = 1, we have Xj = for all j G C(i). 

Now consider any i G E such that Xi(t) = 1. If i ^ m(t), 
then we know Xi(t — 1) = Xi(t) = 1, and since x(t — 1) G M, 
we have Mj G C(i), Xj(t — 1) = 0. In addition, if j ^ m(t), 
then Xj(t) = Xj(t — 1) = based on Step (d) of the scheduling 
algorithm above; otherwise, j G m(t), then since i G C(j) and 
Xi(t — 1) = 1, xj(t) = based on Step (c). 

On the other hand, if i G m(i), from the scheduling 
algorithm we have Xi(t) = 1 only if Xj(t— 1) = 0, V/' G C(i). 
Since i G m(£) and m(t) is feasible, we know C(i) flm(t) = 
0. Therefore, for any j G C(i), Xj(t) = xj(t — 1) = based 
on Step (d). ■ 

Because x(i) only depends on the previous state x(<— 1) and 
some randomly selected decision schedule m(i), x(£) evolves 
as a discrete-time Markov chain (DTMC). Next we will derive 
the transition probabilities between the states (transmission 
schedules). 

Lemma 2: A state x G M. can make a transition to a state 
x' G M. if and only ifxUx' G M. and there exists a decision 
schedule m G A^o such that 

x A x' = (x \ x') U (x' \ x) C m, 

and in this case the transition probability from x to x' is: 

pm = e «( m )( n w)( n ?*) 

raeMoixAx'Cm (Gx\x' fc6x'\x 

( n «)( n &)-<3) 

iemn(xnx') jem\(xUx')\C(xUx') 

Proof: (Necessity) Suppose x is the current state and x' 
is the next state, x \ x' = {/ : x; = 1, xj = 0} is the set 
of links that change their state from 1 (active) to (inactive), 
x' \ x = {k : Xfc — 0, x' fe = 1} is the set of links that change 
their state from to 1. From the scheduling algorithm, a link 
can change its state only if the link belongs to the decision 
schedule. Therefore, x can make a transition to x' only if 
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there exists an m G Mo such that the symmetric difference 
x A x' = (x \ x') U (x' \ x) Cm. In addition, since 

(xHx') U(x\x') =x G M, 

(xnx')u(x'\x) =x' eM, 

(x\x')U(x\x')=xAx'gAL 

we have 

x U x' = (x \ x') U (x \ x') U (x n x') G M. 

{Sufficiency) Now suppose x U x' G M. and there exists 
an m S A^o sucn that x A x' C m. Given m is the 
selected decision schedule, we can calculate the (conditional) 
probability that x makes a transition to x', by dividing the 
links in m into the following five cases: 

(1) lex\x': link I decides to change its state from 1 to 0, 
this occurs with probability pi based on Step (b) in the 
scheduling algorithm; 

(2) k G x' \ x: link k decides to change its state from to 
1, this occurs with probability pk based on Step (a); 

(3) i G m n (x n x'): link i decides to keep its state 1, this 
occurs with probability pi based on Step (a); 

(4) e G mnC(x) where C(x) = U; ex C(7): link e has to keep 
its state 0, this occurs with probability 1 based on Step 
(c); 

(5) j G m \ (x U x') \ C(x): link j decides to keep its state 
0, this occurs with probability pj based on Step (b). 

Note that m n C(x' \ x) =0 because x' \ x C m, we have 
m \ (x U x') \ C(x) = m \ (x U x') \ C(x U x'). Since each 
link in m makes its decision independently of each other, 
we can multiply these probabilities together. Summing over 
all possible decision schedules, we get the total transition 
probability from x to x' given in (01. ■ 

Proposition 1: A necessary and sufficient condition for the 
DTMC of the transmission schedules to be irreducible and 
aperiodic is 



UmEAio m E, 



(4) 



and in this case the DTMC is reversible and has the following 
product-form stationary distribution: 



*w = 4nl 



z 
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En 



Pi 



(5) 
(6) 



Proof: If U me A4 m 7^ E> suppose I ^ U me A4 m ' men 
from state the DTMC will never reach a feasible schedule 
including I. (There exists at least one such schedule, e.g., the 
schedule with only I being active.) 

On the other hand if U m gA^ n m = E, men usm g Lemma |2] 
it is easy to verify that state can reach any other state x G M. 
with positive probability in a finite number of steps and vice 
versa. To prove this, suppose x = {lx, I2, l m }- Define Xj = 
{Zi, for j — 0, ...,m. Note that x = and x m = x. 

Now for < j < m — 1, Xj U x J+1 = x J+1 G M. and 
Xj A x J+1 = {lj+i}- Since U me M m = E, there exists an 
m G A4q such that {lj+i} Q m. Then by Lemma |2] x^ can 



make a transition to Xj+i with positive probability as given in 
yj, hence can reach x with positive probability in a finite 
number of steps. The reverse argument is similar. Therefore, 
the DTMC is irreducible and aperiodic. 

In addition, if state x can make a transition to state x', then 
we can check that the distribution in © satisfies the detailed 
balance equation: 

7r(x)P(x,x') = 7r(x')P(x',x), (7) 

hence the DTMC is reversible and © is indeed its stationary 
distribution (see, for example, lfl5ll ). ■ 

A. Comments On Throughput-Optimality 

Based on the product-form distribution in Proposition Q] 
and by choosing the link activation probabilities as appropriate 
functions of the queue lengths, one can then proceed as in lfl2ll 
(under a time-scale separation assumption) or as in ||24]| (with- 
out such an assumption) to establish throughput-optimality of 
the scheduling algorithm. Instead of pursuing such a proof 
here, we point out an alternative simple proof of throughput- 
optimality under the time-scale separation assumption in lfl2ll . 

We associate each link i G E with a nonnegative weight 
u>i(t) in time slot t. Recall that MWS selects a maximum- 
weight schedule x* (t) in every time slot t such that 



y wi{t) — max \ Wi(t). 

iex*(t) i£x 



(8) 



Let qt (t) be the queue length of link i at the beginning of 
time slot t. It was proved in [26 1 that MWS is throughput- 
optimal if we let Wi(t) = qi(t). This result was generalized 
in |9l as follows. For all i G E, let link weight Wi(t) = 
fi(qi(t)), where f L : [0, 00] — > [0, 00] are functions that satisfy 
the following conditions: 

(1) fi(qi) is a nondecreasing, continuous function with 
Hindoo fi(qi) = 00. 

(2) Given any Mi > 0, M 2 > and < e < 1, there exists 
a Q < 00, such that for all qi > Q and Vi, we have 

(l-e)/i(ft) < fiifh-Mx) < fi(qi+M 2 ) < (l+e)f t (q t ). 

The following result was established in |9|. 

Theorem 1: For a scheduling algorithm, if given any e and 
S, < e, 5 < 1, there exists a B > such that: in any time slot 
t, with probability greater than 1 — 5, the scheduling algorithm 
chooses a schedule x(i) G A4 that satisfies 



iSx(t) 



> O-e) 



e ) max 



£>i(t) 



(9) 



i(Ex 



whenever ||q(i)|| > B, where q(t) = (qi(t) : i G E). Then 
the scheduling algorithm is throughput-optimal. 
If we choose the link activation probability 

p w t (t) 



Pi 



, Vi G E, 



(10) 



then (O becomes 



*M - II II 
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(11) 
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Hence the (steady-state) probability of choosing a schedule is 
proportional to its weight, so the schedules with large weight 
will be selected with high probability. This is the intuition 
behind our proof. 

By appropriately choosing the link weight functions /j's, we 
can make the DTMC of the transmission schedules converge 
much faster compared to the dynamics of the link weights. 
For example, = aqi with a small a is suggested as a 

heuristic to satisfy the time-scale separation assumption in lfl2l 
and fi(qi) — loglog(gi + e) is used in the proof of throughput- 
optimality in ll24l to essentially separate the time scales. Here, 
as in [ 12 1, we simply assume that the DTMC is in the steady- 
state in every time slot. 

Proposition 2: Suppose the basic scheduling algorithm sat- 
isfies U me jvt m = E and hence has the product-form 
stationary distribution. Let pi = e ^. ( ' f)+1 , Vi G E, where 
Wi(t)s are appropriate functions of the queue lengths. Then 
the scheduling algorithm is throughput-optimal. 

Proof: We prove the proposition using Theorem Q] Now 
given any e and S such that < e,6 < 1. Let w*(i) := 
max x6J n J2 iex Wi(t). Define 

#:={xgM: ^2wi(t) < (1 -e)w*(t)\. 

Since the DTMC has the product-form stationary distribu- 
tion in (fTTl i. we have 

n(X) = 5>(x) = ]T 

\ X Ul-e) W *(t) 2 \E\ 

< <^FW V d2) 

where ([T2j is true because \X\ < \M\ < 2 |£| , and 

Therefore, if 

w*(t) > i(|S|log2 + logi), (13) 

then tt(X) < S. Since w*(t) is a continuous, nondecreasing 
function of gi(i)'s, with rimnq^n^oo w*(t) — oo, there exits 
a B > such that whenever ||q(i)|| > B, (O holds and 
then tt{X) < 6. Hence the scheduling algorithm satisfies the 
condition of Theorem Q] and is throughput-optimal. ■ 

IV. Distributed Implementation: Q-CSMA 

In this section we present a distributed implementation of 
the basic scheduling algorithm. The key idea is to develop a 
distributed randomized procedure to select a (feasible) decision 
schedule in the control slot. To achieve this, we further divide 
the control slot into control mini-slots. Note that once a link 
knows whether it is included in the decision schedule, it can 
determine its state in the data slot based on its carrier sensing 
information (i.e., whether its conflicting links were active in 
the previous data slot) and activation probability. We call this 
implementation Q-CSMA (Queue-length based CSMA/CA), 
since the activation probability of a link is determined by 



its queue length to achieve maximum throughput (as in Sec- 
tion ITTT-A| i. and collisions of data packets are avoided via 
carrier sensing and the exchange of control messages. 

At the beginning of each time slot, every link i will 
select a random backoff time. Link i will send a message 
announcing its INTENT to make a decision at the expiry 
of this backoff time subject to the constraints described below. 



Q-CSMA Algorithm (at Link i in Time Slot t) 



1. Link i selects a random (integer) backoff time Ti uni- 
formly in [0, W — 1] and waits for control mini-slots. 

2. IF link i hears an INTENT message from a link in 
C(i) before the (Ti + l)-th control mini-slot, i will not 
be included in m(i) and will not transmit an INTENT 
message anymore. Link i will set Xi(t) — Xi(t — 1). 

3 IF link i does not hear an INTENT message from any 
link in C(i) before the (Ti + l)-th control mini-slot, it 
will send (broadcast) an INTENT message to all links in 
C(i) at the beginning of the (Ti + l)-th control mini-slot. 

- If there is a collision (i.e., if there is another link in 
C(i) transmitting an INTENT message in the same 
mini-slot), link i will not be included in m(t) and 
will set Xi(t) = Xi(t — 1). 

- If there is no collision, link i will be included in 
m(t) and decide its state as follows: 

if no links in C(i) were active in the previous data 
slot 

Xi(t) = 1 with probability pi, < Pi < 1; 
Xi(t) = with probability pi = 1 — pi. 
else 

Xi(t) = 0. 

4. IF Xi(t) = 1, link i will transmit a packet in the data 
slot. 



Lemma 3: m(t) produced by Q-CSMA is a feasible sched- 
ule. Let A4q be the set of all decision schedules produced by 
Q-CSMA. If the window size W > 2, then U mSj vi m = E. 

Proof: Under Q-CSMA, link i will be included in the 
decision schedule m(t) if and only if it successfully sends an 
INTENT message to all links in C(i) without a collision in 
the control slot. This will "silence" the links in C(i) so those 
links will not be included in m(t). Hence m(i) is feasible. 

Now for any maximal schedule m (a schedule is maximal 
if no additional links can be added to the schedule without 
violating its feasibility), note that m will be selected in the 
control slot if Ti = 0, Vi G m, and T 3 = 1, Vj ^ m. This 
occurs with positive probability if W > 2, because, 

a(m) > Pr{T, = 0,Vi G m; T 3 = l,Vj i m} = ]J -L > 0. 

Since the set of all maximal schedules will include all links, 
U me M n m = E if W>2. ■ 

Combining Lemma [3] and Propositions [T] |2] we have the 
following result. 
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Proposition 3: Q-CSMA has the product-form distribution 
given in Proposition \l\if W > 2. Further, it is throughput- 
optimal if we let pi — e ^ i( t )+1 , Vi G £/, where Wi (t)s are 
appropriate functions of the queue lengths. 

Remark 1: A control slot of Q-CSMA consists of W mini- 
slots and each link needs to send at most one INTENT mes- 
sage. Hence Q-CSMA has constant (and low) signalling/time 
overhead, independent of the size of the network. Suppose the 
duration of a data slot is D mini-slots. Taking control overhead 
into account, Q-CSMA can achieve D + w of the capacity 
region, which approaches the full capacity when W -C D. 

Remark 2: We can slightly modify Q-CSMA as follows: in 
Step 3, if link i does not hear an INTENT message from any 
link in C(i) before the (T, + l)-th control mini-slot, i will send 
an INTENT message to all links in C(i) at the beginning of the 
(Tj + l)-th control mini-slot with some (positive) probability 
di. In this case we can show that Q-CSMA achieves the 
product-form distribution even for W = 1. (We thank Libin 
Jiang for this observation.) 

When describing the Q-CSMA algorithm, we treat every 
link as an entity, while in reality each link consists of a 
sender node and a receiver node. Both carrier sensing and 
transmission of data/control packets are actually conducted by 
the nodes. In Appendix [A] we provide details to implement 
Q-CSMA based on the nodes in the network. Such an imple- 
mentation also allows us to resolve the hidden and exposed 
terminal problems associated with wireless networks |2), see 
Appendix [B] 

V. A Low-Delay Hybrid Q-CSMA Algorithm 

By Little's law, the long-term average queueing delay expe- 
rienced by the packets is proportional to the long-term average 
queue length in the network. In our simulations (see Section 
IVIb we find that the delay performance of Q-CSMA can be 
quite bad and much worse than greedy maximal scheduling 
GMS (this is also true in simulations of the continuous-time 
CSMA algorithm). However, GMS is a centralized algorithm 
and is not throughput-optimal in general (there exist networks, 
e.g., the 9-link ring network in Section IVI-B1 where GMS can 
only achieve 2/3 of the capacity region). 

We are therefore motivated to design a distributed schedul- 
ing algorithm that can combine the advantages of both Q- 
CSMA (for achieving maximum throughput) and GMS (for 
achieving low delay). We first develop a distributed algorithm 
to approximate GMS, which we call D-GMS. 

The basic idea of D-GMS is to assign smaller backoff 
times to links with larger queue lengths. However, to handle 
cases where two or more links in a neighborhood have the 
same queue length, some collision resolution mechanism is 
incorporated in D-GMS. Further, we have conducted extensive 
simulations to understand how to reduce the control overhead 
required to implement D-GMS while maintaining the ability 
to control the network when the queue lengths become large. 
Based on these simulations, we conclude that it is better to use 
the log of the queue lengths (rather than the queue lengths 
themselves) to determine the channel access priority of the 
links. The resulting D-GMS algorithm is described below. 



D-GMS Algorithm (at Link i in Time Slot t) 



1. Link i selects a random backoff time 

T< = W x IB - log b ( qi (t) + 1)J+ + Uniform[0, W-l] 

and waits for Tj control mini-slots. 

2. IF link i hears an RESV message (e.g., an RTS/CTS pair) 
from a link in C(i) before the (Ti + l)-th control mini- 
slot, it will not be included in x(t) and will not transmit 
an RESV message. Link i will set Xi(t) = 0. 

3. IF link i does not hear an RESV message from any link in 
C(i) before the (Ti + l)-th control mini-slot, it will send 
an RESV message to all links in C(i) at the beginning of 
the (Tj + l)-th control mini-slot. 

- If there is a collision, link i will set Xi(t) = 0. 

- If there is no collision, link i will set Xi(t) = 1. 

4. IF Xi(t) = 1, link i will transmit a packet in the data 
slot. 



Remark 3: In the above algorithm, each control slot can be 
thought as B frames, with each frame consisting of W mini- 
slots. Links are assigned a frame based on the log of their 
queue lengths and the W mini-slots within a frame are used 
to resolve contentions among links. Hence a control slot of 
D-GMS consists of W x B mini-slots, and links with empty 
queues will not compete for the channel in this time slot. 

Now we are ready to present a hybrid Q-CSMA algorithm 
which is both provably throughput-optimal and has very good 
delay performance in simulations. The basic idea behind the 
algorithm is as follows. For links with weight greater than 
a threshold wq, the Q-CSMA procedure (as in Section UVb 
is applied first to determine their states; for other links, the 
D-GMS procedure is applied next to determine their states. 
To achieve this, a control slot is divided into Wq mini-slots 
which are used to perform Q-CSMA for links whose weight 
is greater than wq and W\ x B mini-slots which are used to 
implement D-GMS among the other links. Each link i uses a 
one-bit memory NAi to record whether any of its conflicting 
links becomes active due to the Q-CSMA procedure in a time 
slot. This information is used in constructing a schedule in 
the next time slot. 



Hybrid Q-CSMA (at Link i in Time Slot t) 



IF Wi(t) > w (Q-CSMA Procedure) 

1.1 Link i selects a random backoff time 

Ti = Uniform[0, Wo - 1]. 

1.2 If link i hears an INTENT message from a link in C(i) 
before the (T,; + l)-th control mini-slot, then it will set 
Xi(t) = Xi(t — 1) and go to Step 1.4. 

1.3 If link i does not hear an INTENT message from any 
link in C(i) before the (Ti + l)-th control mini-slot, it 
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will send an INTENT message to all links in C(i) at the 
beginning of the (Tj + l)-th control mini-slot. 

• If there is a collision, link i will set Xi(t) = Xi(t — 1). 

• If there is no collision, link i will decide its state as 
follows: 

if no links in C(i) were active due to the Q-CSMA 
procedure in the previous data slot, i.e., NAi = 

Xi(t) = 1 with probability p i7 < pt < 1; 

Xi{t) = with probability pi = 1 — pj,. 
else 

Xi{t) =0. 

1.4 If = 1, link i will send an RESV message to all 
links in C(i) at the beginning of the (Wo + l)-th control 
mini-slot. It will set NAi = and transmit a packet in 
the data slot. 

If Xi (t) = and link i hears an RESV message from any 
link in C(i) in the (Wo + l)-th control mini-slot, it will 
set NA4 = 1; otherwise, it will set NAi = 0. 

IF Wi(t) < w (D-GMS Procedure) 

2.1 If link i hears an RESV message from any link in C(i) 
in the (Wo + l)-th control mini-slot, it will set NAi = 1 
and Xi (t) = and keep silent in this time slot. 
Otherwise, link i will set NAi = and select a random 
backoff time 



Ti = (Wo + 1) + Wi x [B 
+Uniform[0, Wi - 1] 



log, (?i(t) + l)J- 



and wait for Ti control mini-slots. 

2.2 If link i hears an RESV message from a link in C(i) 
before the (Ti + l)-th control mini-slot, it will set Xi(t) = 
and keep silent in this time slot. 

2.3 If link i does not hear an RESV message from any link in 
C(i) before the (Tj + l)-th control mini-slot, it will send 
an RESV message to all links in C(i) at the beginning of 
the (Ti + l)-th control mini-slot. 

- If there is a collision, link i will set Xi(i) = 0. 

- If there is no collision, link i will set Xi(t) = 1. 

2.4 If Xi(t) — 1, link i will transmit a packet in the data slot. 



Remark 4: The (Wo + l)-th control mini-slot (called tran- 
sition mini-slot, which occurs between the first Wo mini- 
slots and the last W\ x B mini-slots) is reserved for all 
the links which have not been scheduled so far to conduct 
carrier sensing. In this mini-slot those links which have already 
been scheduled (due to the Q-CSMA procedure) will send an 
RESV message so their neighbors can sense and record this 
information in their NA bit. 

Remark 5: Suppose that the link weights are chosen as in 
Section UlI-AI i.e., Wi(t) = fi{qi(t)) is an increasing function 
of qi(t). Thus, Wi(t) ^ wo is equivalent to qi(t) ^ qo, where 
<7o = f (wq) is the queue-length threshold. 

Remark 6: The control overhead of the hybrid Q-CSMA 
algorithm is Wo + 1 + Wl x B per time slot. As in the pure 
D-GMS algorithm, links with empty queues will keep silent 
throughout the time slot. 



A. Throughput-Optimality of Hybrid Q-CSMA Algorithm 

Let L = {i £ E : Wi(t) > w } be the set of links for 
which the Q-CSMA procedure is applied (in time slot t), and 
L c = E \ L. Let x/,(i) = (xi(t) : i G L) be the transmission 
schedule of the links in L. Note that in the hybrid Q-CSMA 
algorithm, scheduling links in L c will not affect the Q-CSMA 
procedure because those links will be scheduled after the links 
in L and their transmissions will not be recorded by their 
neighboring links in the NA bits. Therefore, under fixed link 
weights and activation probabilities (so L is also fixed), x^(t) 
evolves as a DTMC. Further, using similar arguments as in 
the proofs of Propositions [TJ and [3] we have 

Proposition 4: If Wo > 2, then the DTMC describing the 
evolution of the transmission schedule (t) is reversible and 
has the following product-form stationary distribution: 



71"(xl) = 



e n 



Pi 



(14) 



(15) 



where M. l is the set of feasible schedules when restricted to 
links in L. 

Assuming a time-scale separation property that the DTMC 
of Xi (t) is in steady-state in every time slot, we establish the 
throughput-optimality of the hybrid Q-CSMA algorithm in the 
following proposition. 

Proposition 5: For each link i £ L, we choose its activation 
probability pi — e ^. ( ' f)+1 , where the link weights Wi (t) 's are 
appropriate functions of the queue lengths as in Section I7//-A1 
Then the hybrid Q-CSMA algorithm is throughput- optimal. 

Proof: Write x(i) = (x L (t),x L c(i)), where x j4 (t) 
:,/',:/ : i £ A) for any set A C E. Recall that MWS selects 
a maximum-weight schedule x*(i) such that 



«;(**(*)) 



t«(x£(t))+«,(x£.(t)) 



max 



where w(x^(t)) : 
It is clear that 



u>(x2(t)) < max io(xi) = 



(16) 



For any e such that < e < 1, when Hw^H^ > 2 ^" E J t "° 
(so L is not empty), we have 



w* L > maxw,(t) > 



2\E\w 



Therefore, 



w(xj.(t)) < \E\w < -w* L . 



(17) 



Using similar arguments as in the proof of Proposition [2] 
we can show that for any e and S such that < e, 8 < 1, if the 
queue lengths are large enough, then with probability greater 
than 1 — S, the Q-CSMA procedure chooses xz,(t) such that 

w(xlW) >(!-§) max w (x L ) = (1 - ^)w* L . 



x 



In addition, if the queue lengths are large enough, then ( fTTl i 
holds. Therefore, since w(x.L<=(t)) > 0, we have 

u>(x(t)) = u;(xi(t))+w(x L .(i)) 

> (l-eK + |< 

> (l-e)«;(x£(t))+«;(x£.(t)) 

> (l-e)«7*. 

Hence the hybrid Q-CSMA algorithm satisfies the condition 
of Theorem Q] and is throughput-optimal. ■ 
Remark 7: In the above algorithm, one can replace D-GMS 
by any other heuristic and still maintain throughput-optimality. 
We simply use D-GMS because it is an approximation to 
GMS which is known to perform well in a variety of previous 
simulation studies. It is also important to recall our earlier 
observation that GMS is not a distributed algorithm and hence, 
we have to resort to a distributed approximation. 

VI. Simulation Results 

In this section we evaluate the performance of different 
scheduling algorithms via simulations, which include MWS 
(only for small networks), GMS (centralized), D-GMS, 
Q-CSMA, and the hybrid Q-CSMA algorithm. In addition, 
we have implemented a distributed algorithm to approximate 
maximal scheduling (called D-MS), which can be viewed 
as a synchronized slotted version of the IEEE 802.11 
DCF with the RTS/CTS mechanism. Note that D-MS is a 
special case of D-GMS presented in Section [Vl with B = 1 so 
the backoff time of a link does not depend on its queue length. 



D-MS (at Link i in Time Slot t) 

1 . Link i selects a random backoff time 

Ti = Uniform[0, W -1] 

and waits for T control mini-slots. 

2. If link i hears an RESV message from a link in C(i) 
before the (Ti + l)-th control mini-slot, it will not be 
included in the transmission schedule x(t) and will not 
transmit an RESV message. Link i will set Xi(t) = 0. 

3. If link i does not hear an RESV message from any link in 
C(i) before the (Ti + l)-th control mini-slot, it will send 
an RESV message to all links in C(i) at the beginning of 
the (T + l)-th control mini-slot. 

- If there is a collision, link i will set Xi(t) = 0. 

- If there is no collision, link i will set Xi(t) = 1. 

4. If Xi(t) = 1, link i will transmit a packet in the data slot. 
(Links with empty queues will keep silent in this time 
slot.) 



A. A 24-Link Grid Network 

We first evaluate the performance of the scheduling algo- 
rithms in a grid network with 16 nodes and 24 links as shown 




Fig. 1. A 24-link grid network topology. 

in Fig.Q] Each node is represented by a circle and each link is 
illustrated by a solid line with a label indicating its index. Each 
link maintains its own queue. We assume 1-hop interference. 
Consider the following four sets of links: 

A = {1,3,8,10,15,17,22,24}, 

C 2 = {4,5,6,7,18,19,20,21}, 

£ 3 = {1,3, 9, 11, 14, 16, 22, 24}, 

£4 = {2,4,7,12,13,18,21,23}. 

Each set represents a (maximum-size) maximal schedule of 
the network. Let Mj = e£ 4 , where is a vector in which 
the components with indices in Li are l's and others are 0's. 
Then, we let the arrival rate vector be a convex combination 
of those maximal schedules scaled by p: 



P 



4 

£ 

i=l 



dMi, c = [0.2,0.3,0.2,0.3]. 



Note that a convex combination of several maximum-size 
maximal schedules must lie on the boundary of the capacity 
region. Hence the parameter p in [0, 1] can be viewed as 
the traffic intensity, with p — ► 1 representing arrival rates 
approaching the boundary of the capacity region. 

The packet arrivals to each link i follow a Bernoulli process 
with rate Xi independent of the packet arrival processes at 
other links. Each simulation experiment starts with all empty 
queues. For each algorithm under a fixed p, we take the 
average over 10 independent experiments, with each run being 
10 5 time slots. Due to the high complexity of MWS in such 
a large network, we do not implement it here. 

For fair comparison, we choose a control overhead of 48 
mini-slots for every distributed scheduling algorithm (which 
lies in the range of the backoff window size specified in IEEE 
802.11 DCF 0). The parameter setting of the scheduling 
algorithms is summarized below. 

. D-MS: W = 48. 

. D-GMS: B = 3, W = 16; b = 8. 

. Q-CSMA: W = 48; link weight wAt) = log(O.Wi)) 
and link activation probability pi = J D . lt)+1 ■ 

. Hybrid Q-CSMA: W = 5 for the Q-CSMA procedure, 
B = 3 and W x = 14 for the D-GMS procedure, plus 



1 transition mini-slot. The queue-length threshold q 
100. Other parameters are the same as Q-CSMA. 
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(a) Low and Moderate Traffic Intensity 



- GMS 

- D-GMS 

- Q-CSMA 

- Hybrid Q-CSMA 
-D-MS 




(b) High Traffic Intensity 



- GMS 

- D-GMS 
- Q-CSMA 

- Hybrid Q-CSMA 

- D-MS 
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Fig. 2. Long-term average queue length per link in the 24-link grid network. 



Remark 8: In Q-CSMA we choose the link weight function 
Wi(t) — \og(aqi(t)) with a small constant a. The rationality 
is to make the link weights change much slower than the 
dynamics of the CSMA Markov chain (to satisfy the time-scale 
separation assumption). We have tried several other choices for 
the link weight functions suggested in prior literature (such as 
aqi(t) in [12| and loglogfeO) + e) in fl24|) but log{a qi (t)) 
seems to give the best delay performance. 

The performance of the scheduling algorithms is shown in 
Fig. |2] from which we can see that: 

• Under low to moderate traffic intensity, D-GMS and D- 
MS have very good delay performance (small long-term 
average queue length) and perform better than Q-CSMA. 
However, when the traffic intensity is high, the average 
queue length under D-GMS/D-MS blows up and then- 
delay performance becomes much worse than Q-CSMA. 

• Hybrid Q-CSMA has the best delay performance among 
the distributed scheduling algorithms. It retains the stabil- 
ity property of Q-CSMA even under high traffic intensity 
while significantly reduces the delay of pure Q-CSMA. 
Note that when p — > 1, the performance of Hybrid Q- 
CSMA becomes close to pure Q-CSMA since the effect 
of the D-GMS procedure diminishes when the queue 
lengths of most links exceed the queue length threshold. 

• Centralized GMS has excellent delay performance, but it 
is not throughput-optimal in general, as illustrated next. 

We have tested the algorithms under other traffic patterns, 
e.g., different arrival rate vectors, Poisson arrivals, and the 
results are similar. 




Fig. 3. A 9-link ring network topology. 



B. A 9-Link Ring Network 

Consider a 9-link ring network under the 2-hop interference 
model, as shown in Fig. [3] It was shown in [16] that GMS can 
only achieve 2/3 of the capacity region in this network. To 
see this, we construct a traffic pattern using the idea in fl4l . 
Define 

C t = {i, (i + 4) mod 9}, 1 < i < 9. 

Starting with empty queues, in time slot 9k + i (fee Z), one 
packet arrives at each of the 2 links in Li, and, with probability 
e, an additional packet arrives at each of the 9 links. The 
average arrival rate vector is then A = (| + e)e, where e is a 
vector with all components equal to 1. It has been shown in 
ITMl that GMS will lead to infinite queue lengths under such 
a traffic pattern for all e > 0. 

On the other hand, we could use a scheduling policy as 
follows. Define 

C x = {1,4,7}, C 2 = {2,5,8}, C 3 = {3,6,9}, 

and let M, = e^. for 1 < i < 3. In time slot 3fc + i (k 6 Z), 
the maximal schedule Mj is used. Hence, the average service 
rate vector is = -|e. When < e < i, A < fi, i.e., A lies 
in the interior of the capacity region, but GMS cannot keep 
the network stable as we saw above. 

We evaluate the performance of the scheduling algorithms 
under the above traffic pattern. Each simulation experiment 
starts with all empty queues. For each algorithm under a 
fixed e, we take the average over 10 independent experiments, 
with each run being 10 5 time slots. We use exactly the same 
parameter setting as in Section IVI-AI 

In Fig. we can see that Q-CSMA and Hybrid Q-CSMA 
have a much lower delay than GMS, D-GMS (when e > 0.03) 
and D-MS (when e > 0.05). Fig. [5] shows that the average 
queue length increases linearly with the running time (# of 
time slots) under D-GMS/D-MS which imply that they are not 
stable, while the average queue length becomes stable under 
Q-CSMA/Hyrbid Q-CSMA. 

VII. Conclusion 

In this paper, we proposed a discrete-time distributed queue- 
length based CSMA/CA protocol that leads to collision- 
free data transmission schedules. The protocol is provably 
throughput-optimal. The discrete-time formulation allows us 
to incorporate mechanisms to dramatically reduce the delay 
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Fig. 4. Long-term average queue length per link in the 9-link ring network. 
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Fig. 5. Sample paths of average queue length per link: e = 0.09. 



without affecting the theoretical throughput-optimality prop- 
erty. In particular, combining CSMA with distributed GMS 
leads to very good delay performance. 

We believe that it should be straightforward to extend our 
algorithms to be applicable to networks with multi-hop traffic 
and congestion-controlled sources (see lfT8l . iflOl . (25 1 for 
related surveys). 

Appendix 

A. Node-Based Implementation of Q- CSMA 

For any node n in the network, we use Af(n) to denote 
the neighborhood of n, which is the set of nodes that can 
hear the transmission of n. We assume symmetry in hearing: 
if n' G Af(n) then n G Af{n'). 

Let Si and be the sender node and receiver node of 
link i, respectively. If link i is included in the transmission 
schedule, then in the data slot, s$ will send a data packet 
to Ti, and r, will reply an ACK packet to Sj. We assume 
that the data transmission from s, to fj is successful if no 
nodes in A/*(rj) are transmitting in the same time; similarly, 



the ACK transmission from to s$ is successful if no nodes 
in Af(si) are transmitting in the same time. We also consider 
the node-exclusive constraint that two active links cannot 
share a common node. Therefore, in a synchronized data/ ACK 
transmission system, the conflict set of link i is: 

C(i) = jj : j shares a common node with i, 

or Sj G N(r.i), or rj G A/"(si).j. 

In summary, two links i and j conflict with each other, i.e., 
i G C(j) and j G C(i), if they share a common node, or if 
simultaneous data transmissions at s, and Sj will collide at 
r, and r 3 -, or if simultaneous ACK transmissions at r» and Tj 
will collide at Sj and Sj, 

We say that a node is active in a time slot if it is the sender 
node or receiver node of an active link. In a time slot, each 
inactive node will conduct carrier sensing. It will determine 
whether there are some active sender nodes and some active 
receiver nodes in its neighborhood by sensing whether the 
channel is busy during the data transmission period and during 
the ACK transmission period, respectively. In this way, link i 
"knows" that no links in its conflict set are active in a time 
slot, if Si and r,; don't belong to an active link other than i, Sj 
does not sense an active receiver node in A/"(sj), and r< does 
not sense an active sender node in A/'(r i ). 

Similar to the RTS/CTS mechanism in the 802.11 MAC 
protocol, an INTENT message "sent" by a link consists of an 
RTD (Request-To-Decide) and a CTD (Clear-To-Decide) pair 
exchanged by the sender node and receiver node of the link. 
To achieve this, we further divide a control mini-slot into two 
sub-mini-slots. In the first sub-mini-slot, s$ sends an RTD to 
Ti. If r, receives the RTD without a collision (i.e., no nodes in 
N(ri) are transmitting in the same sub-mini-slot), then r, will 
reply a CTD to Sj in the second sub-mini-slot. If Si receives 
the CTD from n without a collision, then link i — (si,n) 
will be added to the decision schedule. We choose the length 
of a sub-mini-slot such that an RTD or CTD sent by any node 
can reach its neighbors within one sub-mini-slot. Note that the 
exchange of an RTD/CTD pair between the sender and receiver 
of a link will "silence" all its conflicting links so those links 
will not be added to the decision schedule anymore. 

Now we are ready to present the node-based Q-CSMA algo- 
rithm. Some additional one-bit memories maintained at node 
n (in time slot t) are summarized below (each explanation 
corresponds to bit 1): 

• AS n (t)/AR n (t): n is available as the sender/ receiver 
node for a link in the decision schedule m(t). 

• ACT n (t): n is active (as either a sender or receiver node). 

• NS n (t) j NR n (t): the neighborhood of n (i.e, Af(n)) has 
an active sender/receiver node. 

Q-CSMA Algorithm (at Node n in Time Slot t) 

1. At the beginning of the time slot, node n sets AS n (t) = 1 
and AR n (t) = 1. 

Let L(n) be the set of links for which n is the sender 
node (i.e., n = si, VI G L(n)). Node n randomly chooses 
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one link in L(n) (suppose link i — (n, m) is chosen) 
and selects a backoff time Ti uniformly in [0, W — 1]. 
Other links in L(n) will not be included in m(t), so 
xi{t) = xi(t-l),Vl e L(n)\i 

2. Throughout the control slot, if node n senses an RTD 
transmission not intended for itself (or a collision of 
RTDs) by a node in Af(n), n will no longer be available 
as the receiver node for a link in m(t). Thus, node n will 
set AR n (t) = 0. 

3. Before the (Tj + l)-th control mini-slot, if node n senses 
a CTD transmission by a node in Af(n) (or a collision of 
CTDs), n will no longer be available as the sender node 
for a link in m(t), and it will set AS n (t) = 0. In this case 
link i will not be included in m(i) and Xi(t) — Xi(t— 1). 

4. At the beginning of the (Ti + l)-th control mini-slot, if 
■ASn{t) — 1> node n will send an RTD to node m in 
the first sub-mini-slot. Node n will then set AS n (t) = 
AR n {t) = 0. 

4.1 If node m receives the RTD from node n without 
a collision and AR m (t) = 1, m will send a CTD 
to n in the second sub-mini-slot of the (T j; + l)-th 
control mini-slot. Node m will then set AS m (t) = 
ARm{t) = 0. The CTD message also includes the 
carrier sensing information of node m in the previous 
time slot (the values of MJT m (t— 1) and AK m (i-l)). 
Otherwise, no message will be sent. 

4.2 If node n receives the CTD message from node m 
without a collision, link i = (n, m) will be included 
in m(t). Node n will decide link i's state as follows: 

if no links in C(i) were active in the previous data 
slot, i.e., Xi(t-1) = 1 or AJT n (t-l) = KJT m (t- 
1) = NR n (t - 1) = NS m (t - 1) = 

Xi(t) — 1 with probability pi, < pi < 1; 
= with probability pi = 1 — pi. 

else 

a:i(t) = 0. 

Otherwise, link i will not be included in m(t) and 
£Cj (t) = Xi(t - 1). 

5. In the data slot, node n takes one of the three different 
roles: 

- Sender. xi{t) = 1 for some link I = (n,m) 6 E. 
Node n will send a data packet to node m and set 

MJT n {t) = 1. 

- Receiver. xi(t) = 1 for some link I — (m,n) e E. 
Node n will send an ACK packet to node m (after it 
receives the data packet from to) and set MJT n (t) = 
1. 

- Inactive: Node n sets AJT n (t) — and conducts 
carrier sensing. Recall that data/ACK transmissions 
in our system are synchronized. Thus, node n will 
set NS n (t) = if it senses no signal during the data 
transmission period and set NS n (t) = 1 otherwise. 
Similarly, node n will set NR n (t) = if it senses 
no signal during the ACK transmission period and 
set NR n (t) = 1 otherwise. 



Remark 9: Note that RTD and CTD are sent in two differ- 




Fig. 6. Hidden and Exposed Terminal Problems 

ent sub-mini-slots. This provides an easy way to differentiate 
RTD and CTD (or collisions of RTDs and CTDs, respectively) 
without having to encode the packet type in a preamble bit of 
such a control packet (actually when a collision happens, a 
node cannot even check this "packet type" bit to differentiate 
RTD and CTD). 

Proposition 6: m(t) produced by the node-based Q-CSMA 
algorithm is a feasible schedule. Let M$ be the set of decision 
schedules produced by the algorithm. If the window size 
W > 2, then U me ^ m = E an d tne algorithm achieves 
the product-form distribution in Proposition [7] 

Proof: The proof is similar to the proof of Lemma [3] 
Under the node-based Q-CSMA algorithm, link i will be 
included in the decision schedule m(i) if and only if its sender 
and receiver nodes successfully exchange an RTD/CTD pair in 
the control slot. This will "silence" all the receivers in AA(sj) 
and all the senders in in N(ri) as well as nodes s, and Ti, 
so no links in C(i) will be included in m(t). Hence m(t) is 
a feasible schedule. Similarly, for any maximal schedule m, 
we can check that m will be selected in the control slot with 
positive probability if the window size W > 2. Since the set of 
all maximal schedules will include all links, U me x m = E. 
Then by Proposition Q] the node-based Q-CSMA algorithm 
achieves the product-form distribution. ■ 

B. Elimination of Hidden and Exposed Terminal Problems 

In IEEE 802.11 DCF, the RTS/CTS mechanism is used 
to reduce the Hidden Terminal Problem. However, even if 
RTS/CTS is used, the hidden terminal problem can still occur, 
as illustrated in Fig. [6] where we use Si and Ri to denote the 
sender and receiver (in the sense of data transmission) of link 
i. Under 802.1 1, it is possible that S% is sending an RTS to i?2 
while i?i is returning a CTS to Si at the same time. R\ cannot 
detect the RTS from S2 since it is transmitting. Likewise, S2 
cannot detect the CTS from i?2- Therefore, both links 1 and 
2 could be scheduled, which causes a collision at R\. 

Our Q-CSMA algorithm, however, can resolve the hidden 
terminal problem because the RTD/CTD messages are ex- 
changed in a synchronized manner. Suppose Tj is the backoff 
expiration time of node Si. 

. Ti < T 2 : During the (Ti + l)-th mini-slot, Si sends an 
RTD in the first sub-mini-slot, then in the second sub- 
mini-slot, i?i returns a CTD, and link 1 will be included 
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in the decision schedule. Since this CTD is not intended 
for 5*2, S% disables its role as a sender of a link in the 
decision schedule, thus link 2 will not be included in the 
decision schedule. 
. Ti =T 2 : During the (2\ + l)-th mini-slot , both Si and 
S2 send an RTD in the first sub-mini-slot. In this case, 
i?i senses a collision of RTD and will not return a CTD. 
Thus, link 1 will not be included in the decision schedule, 
while link 2 will be included in the decision schedule. 
• T\ > T2: Similarly, in this case link 2 but not link 1 will 
be included in the decision schedule. 
Therefore, under synchronized RTD/CTD, the decision sched- 
ule is collision-free, which implies that the transmission sched- 
ule is collision-free if we start with a collision-free transmis- 
sion schedule (e.g., the empty schedule), see LemmaQ] Hence 
the hidden terminal problem is eliminated. 

Another problem, known as the Exposed Terminal Prob- 
lem, may also occurs under 802.11. In Fig. [6j if Si sends an 
RTS to Ri, S3 will receive this RTS and will be silenced 
under 802.11, which is unnecessary because the potential 
transmission of link 3 will not interfere with link 1. On the 
other hand, under Q-CSMA, if Si sends an RTD to Ri, S3 will 
ignore this RTD and can still send an RTD to R3. Therefore, 
both links 1 and 3 can be included in the decision schedule 
and in the transmission schedule, thus avoiding the exposed 
terminal problem. 

Note that the presence of hidden and exposed terminals not 
only leads to loss of efficiency, but also poses mathematical 
difficulties. For example, when there are hidden and exposed 
terminals in an 802. 11 -type asynchronous RTS/CTS model, it 
is impossible to define a set of schedules that are consistent 
with both the definition of a feasible schedule as defined in 
(fl~|l and the capacity region as defined in ©. Our RTD/CTD 
mechanism eliminates such problems. 
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